Neural Style Transfer for Audio Spectograms

There has been fascinating work on creating artistic transformations of images by Gatys et al. This was revolutionary in how we can in some sense alter the “style” of an image while generally preserving its “content”. In this work, we present a method for creating new sounds using a similar approach. For demonstration, we investigate two different tasks, resulting in bandwidth expansion/compression, and timbral transfer from singing voice to musical instruments.